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(57) Abstract: The invention describes a method for transmitting data packets over a packet switching network with widely varying 
link speeds. The switches of the network maintain a common time reference (CTR). Each switch along a route from a source to a 
destination forwards data packets in periodic time frames (TFs) of a plurality of durations that are predefined using the CTR. The time 
frame duration can be longer than the time duration required for transmitting a data packet, in which case the exact position of a packet 
in the time frame is not predetermined. In accordance with the present invention, different time frame durations: TF1 , TF2, and so on 
are used for forwarding over links with different capacities. This invention further describes a method for transmitting and forwarding 
data packets over a packet switching and shared media networks. The shared media network can be of various types, including but 
not limited to- IEEE P1394 and Ethernet for desktop computers and room area networks, cable modem head-end (e.g., DOCSIS, 
IEEE 802. 14), wireless base-station (e.g.. IEEE 802.1 1), and Storage Area Network (SAN) (e.g., FC-AL, SSA). The invention further 
describes a method for interfacing a packet-switched network with real-time streams from various sources, such as circuit-switched 
telephony network sources. A data packet that is packetized at the gateway is scheduled to be forwarded to the network in a predefined 
time that is responsive to the common time reference. The invention relates, in particular, to timely forwarding and delivery of 
data packet between voice over IP (VoIP) gateways. Consequently, the invention provides a routing service between any two VoIP 
gateways where the end-to-end performance parameters, such as loss, delay and jitter, have deterministic guarantees. Furthermore, 
the invention enables gateway functions with minimum delay. 
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SCHEDULING WITH DIFFERENT TIME INTERNALS 



RELATED APPLICATIONS 



FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT 
5 Not Applicable. 

BACKGROUND OF THE INVENTION: 

This invention relates to generally to a method and apparatus for transmitting of 
data on a communications network. More specifically, this invention relates to timely 

10 forwarding and delivery of data over the network and to their destination nodes, where 
the destination nodes are connected with point-to-point links or over a multiple access 
shared medium. Consequently, the end-to-end performance parameters, such as, loss, 
delay and jitter, have either deterministic or probabilistic guarantees. 

The proliferation of high-speed communications links, fast processors, and 

15 affordable, multimedia-ready personal computers brings about the need for wide area 
networks that can carry real-time data, like telephony and video. However, the 
end-to-end transport requirements of real-time multimedia applications present a major 
challenge that cannot be solved satisfactorily by current networking technologies. Such 
applications as video teleconferencing, and audio and video group (many-to-many) 

20 multicasting generate data at a wide range of bit rates and require predictable, stable 
performance and strict limits on loss rates, end-to-end delay bounds, and delay 
variations ("jitter"). These characteristics and performance requirements are 
incompatible with the services that current circuit and packet switching networks can 
offer. 

25 Circuit-switching networks, which are still the main carrier for real-time traffic, 

are designed for telephony service and cannot be easily enhanced to support multiple 
services or carry multimedia traffic. Its synchronous byte switching enables 
circuit-switching networks to transport data streams at constant rates with little delay or 
jitter. However, since circuit-switching networks allocate resources exclusively for 

30 individual connections, they suffer from low utilization under bursty traffic. Moreover, 
it is difficult to dynamically allocate circuits of widely different capacities, which makes 
it a challenge to support multimedia traffic. Finally, the synchronous byte switching of 
SONET, which embodies the Synchronous Digital Hierarchy (SDH), requires 
increasingly more precise clock synchronization as the lines speed increases [John C. 

35 Bellamy, "Digital Network Synchronization", IEEE Communications Magazine , April 
1995, pages 70-83]. 
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Packet switching networks like IP (Internet Protocol}-based Internet and 
Intranets [see, for example, A-Tannebaum, Computer Networks (3rd Ed) Prentice Hall, 
1996] and ATM (Asynchronous Transfer Mode) [see, for example, Handel et al., ATM 
Networks: Concepts, Protocols, and Applications (2nd Ed.) Addison-Wesley, 1994] 
handle bursty data more efficiendy than circuit switching, due to their statistical 
multiplexing of the packet streams. However, current packet switches and routers 
operate asynchronously and provide best effort service only, in which end-to-end delay 
and jitter are neither guaranteed nor bounded Furthermore, statistical variations of 
traffic intensity often lead to congestion that results in excessive delays and loss of 
packets, thereby significantly reducing the fidelity of real-time streams at their points of 
reception. 

Efforts to define advanced services for both IP and ATM have been conducted in 
■ two levels: (1) definition of sendee, and (2) specification of methods for providing 
different services to different packet streams. The former defines interfaces, data 
formats, and performance objectives. The latter specifies procedures for processing 
packets by hosts and switches/routers. The types of services that defined for ATM 
include constant bit rate (CBR), variable bit rate (VBR) and available bit rate (ABR). 

The real-time transport protocol (RTP) [H. Schultzrinne et. al, "RTP; A 
Transport Protocol for Real-Time Applications", IETF Request for Comment 
RFC1889, January 1996] is a method for encapsulating time-sensitive data packets and 
attaching to the data time related information like time stamps and packet sequence 
number. 

One approach to an optical network that uses synchronization was introduced in 
the synchronous optical hypergraph [Y. Ofek, 'The Topology, Algorithms And 
Analysis Of A Synchronous Optical Hypergraph Architecture", Ph.D. Dissertation, 
Electrical Engineering Department, University of Illinois at Urbana, Report No. 
UIUCDCS-R-87-1343i May 1987], which also relates to how to integrate packet 
telephony using synchronization [ Y. Ofek, "Integration Of Voice Communication On A 
Synchronous Optical Hypergraph", IEEE INFOCOM'88, 1988]. In the synchronous 
optical hypergraph, the forwarding is performed over hyper-edges, which are passive 
optical stars. In [Li et aU "Pseudo-Isochronous Cell Switching In ATM Networks", 
IEEE INFOCOM'94, pages 428-437, 1994; Li et al., 'Time-Driven Priority: How 
Control For Real-Time Heterogeneous Internetworking", IEEE INFOCOM'96, 1996] 
the synchronous optical hypergraph idea was applied to networks with an arbitrary 
topology and with point-to— point links. The two papers [Li et al., "Pseudo- 
Isochronous Cell Switching In ATM Networks", IEEE INFOCOMV4, pages 428-437, 
1994; Li et al., 'Time-Driven Priority: Flow Control For Real-Tune Heterogeneous 
Internetworking", IEEE INFOCOM'96, 1996] provide an abstract (high level) 
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description of what is caUed "RISC-like forwarding", in which a packet is forwarded, 
with little if any details, one hop every time frame in a manner similar to the execution of 
instructions in a Reduced Instruction Set Computer (RISC) machine. 

This invention also relates to generally to a method and apparatus for 

5 transmitting of data on a communications network. More specifically, this invention 

relates to timely forwarding and delivery of data packets over the network to Voice over 
Internet Protocol (VoIP) gateways (see for example: [M. Hamdi, O. Verscheure, J-P 
Hubaux, I. Dalgic, and P. Wang, Voice Service Interworking and IP Networks, IEEE 
Communications Magazine, May 1999, pp. 104-111]). Consequently, between any two 

10 VoIP gateways the end-to-end performance parameters, such as, loss, delay and jitter, 
have deterministic guarantees. 

In U.S. Pat No. 5,418,779, Yemini et al. discloses switched network architecture 
• with common time reference. The time reference is used in order to determine the time 
in which multiplicity of nodes can transmit simultaneously over one predefined routing 

15 tree to one destination. At every time instance the multiplicity of nodes are transmitting 
to different single destination node. 

SUMMARY OF THE INVENTION: 

In accordance with the present invention, a method is disclosed providing virtual 
20 pipes that carry real-time traffic over packet switching networks with widely varying link 
speeds, while guaranteeing end-to-end performance. The method combines the 
advantages of both circuit and packet switching. It provides for allocation for the 
exclusive use of predefined connections and for those connections it guarantees loss 
free transport with low delay and jitter. When predefined connections do not use their 
25 allocated resources, other non-reserved data packets can use them without affecting the 
performance of the predefined connections. 

Under the aforementioned prior art methods for providing packet switching 
services, switches and routers operate asynchronously. The present invention provides 
real-time services by synchronous methods that utilize a time reference that is common 
30 to the switches and end stations comprising a wide area network. The common time 

reference can be realized by using UTC (Coordinated Universal Time), which is globally 
available via, for example, GPS (Global Positioning System - see, for example: [Peter 
H. Dana, "Global Positioning System (GPS) Time Dissemination for Real-Time 
Applications", Real-Time Systems, 12, pp. 9-40, 1997]. By international agreement, 
35 UTC is the same all over the world. UTC is the scientific name for what is commonly 
called GMT (Greenwich Mean Time), the time at the 0 (root) line of longitude at 
Greenwich, England. In 1967, an international agreement established the length of a 
second as the duration of 9,192,631,770 oscillations of the cesium atom. The adoption 
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of the atomic second led to the coordination of clocks around the world and the 
establishment of UTC in 1972. The Time and Frequency Division of the National 
Institute of Standards and Technologies (NIST) (see http://www.boulder.nisLgov/timefrcq) is 
responsible for coordinating UTC with the International Bureau of Weights and 
5 Measures (BIPM) in Paris. 

UTC timing is readily available to individual PCs through GPS cards. For 
example, TrueTime, Inc.'s (Santa Rosa, California) PCI-SG provides precise time, with 
zero latency, to computers that have PCI extension slots. Another way by which UTC 
can be provided over a network is by using the Network Time Protocol (NTP) [D. Mills, 
10 "Network Time Protocol" (version 3) IETF RFC 1305]. However, the clock accuracy 
of NTP is not adequate for inter-switch coordination, on which this invention is based. 

In accordance with the present invention, the synchronization requirements are 
* independent of the physical link transmission speed, while in circuit switching the 
synchronization becomes more and more difficult as the link speed increases. 
15 In accordance with the present invention, timing information is not used for 

routing, and therefore, in the Internet, for example, the routing is done using IP 
addresses or an IP tag/label. 

In accordance with the present invention, timing information is provided by 
using a Common Time Reference (CTR) signal, one such source is the above mentioned 
20 GPS. CTR is used for the timely forwarding over links with plurality of different time 
frame durations: TF1, TF2, and so on. Employing different time frame durations are 
useful in heterogeneous networks with widely varying link speeds, as shown in the 
following table. That is, the number of bytes that can be transmitted during one time 
frame of, say, 500/125/12.5 microseconds changes according to the link capacity. 



Link capacity 


Number of bytes 
per TFs - 125 
microseconds 


Number of bytes 
per TFs - 500 
microseconds 


Number of bytes 
per TFs - 12.5 
microseconds 


10 

Gb/s 


156,250 


625,000 


15,625 


1 

Gb/s 


15,625 


62,500 


1,562 


155 

Mb/s 


2,420 


9,680 


242 


45 

Mb/s 


703 


2,812 


70 



In accordance with the present invention, the synchronous virtual pipes (SVPs) 
are accessed by end-stations that are located across a shared media network. The shared 
media network can be of various types: IEEE PI 394 and Ethernet for desktop 
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computers and room area networks, cable modem head-end (e.g., DOGSIS, IEEE 
802.14), wireless base-station (e.g., IEEE 802.11), and Storage Area Network (SAN) 
(e.g., FC-AL, SSA). The end-station can be of corresponding various types: for IEEE 
1394: video cameras, VCR and video disk; for cable modem: set-top box with multiple 
5 Ethernet connections to video cameras" VCRs; for wireless: desktop computers and 
mobile units; and for SAN: disk drives, tape drives, RAM disks, electronic disks, and 
other storage devices. More specifically: 

IEEE P1394 [PI 394 Standard for a High Performance Serial Bus, IEEE P1394 
Draft 8.0v4, November 21, 1995] - This standard describes a high speed, low cost serial 

10 bus suitable for use as a peripheral bus or a backup to parallel back-plane buses. 

DOCSIS [Data-Over-Cable Service Interface Specifications Radio Frequency 
Interface Specification, SP-RFI-I04-980724]. The goal of this specification is to enable 
' cable operators to deploy high-speed data communications systems on cable television 
systems. It provides definition, design, development and deployment of data-over-cable 

15 systems on an uniform, consistent, open, non proprietary, multi- vendor interoperable 
basis. The intended service will allow transparent bi-directional transfer of Internet 
Protocol (IP) traffic, between the cable system head-end and customer locations, over an 
all-coaxial or hybrid fiber/coax (HFC) cable network. 

IEEE 802.14 [IEEE 802A4/a Draft 3 Revision 2 for Cable-TV access method 

20 and physical layer specification, 1 August, 1998], this standard is intended to provide 
complete support of Asynchronous Transfer Mode (ATM). This support comprises 
supporting the following: (1) The ATM layer service, as defined in ITU-T 
Recommendation 1.150, (2) Transport of ATM cells across the HFC MAC, (3) The five 
ATM Service Categories defined in the ATM Forum Traffic Management specification. 

25 along with their associated Quality-of Service and traffic contract parameters, (4) Point- 
to-point and unidirectional point-to-multipoint ATM virtual connection links, (5) ATM 
Virtual Path (VP) and Virtual Channel (VC) links which are concatenated with other VP- 
and/or VC- links to form VP connections or VC connections, (6) Permanent Virtual 
Connections (PVCs) and Switched Virtual Connections (SVCs), including support for 

30 the ATM Forum Signaling 4.0 specification for establishing and releasing SVCs and the 
Integrated Layer Management Interface (formerly, Interim Layer Management 
Interface). 

IEEE 802.11 [Wireless LAN Medium Access Control (MAC) and Physical 
Layer (PHY) specifications, IEEE Std 802.1 1-1997] - the medium access control 
35 (MAC) and physical characteristics for wireless local area networks (LANs) are 

specified in this standard, part of a series of standards for local and metropolitan area 
networks. The medium access control unit in this standard is designed to support 
physical layer units as they may be adopted dependent on the availability of spectrum. 
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This standard contains three physical layer units: two radio units, both-operating in the 
2400-2500 MHz band, and one base-band infrared unit One radio unit employs the 
frequency-hopping spread spectrum technique, and the other employs the direct 
sequence spread spectrum technique. 
5 There are several variants of Storage Area Network (SAN), for example: (1) 

ANSI standard X3T1 1, FC-AL - Fiber Channel Arbitrated Loop [see, for example, 
Robert W. Kerabel, Arbitrated Loop, Connectivity Solutions, 1997], and (2) ANSI 
standard X3T10, SSA - Serial Storage Architecture [see, for example, Serial Storage 
Architecture A Technology Overview, Version 3.0, SSA Industry Association 1995]. 

1 0 SAN provides connectivity for a wide variety of storage devices, such as, disk drives, 
tape drives, RAM disks, electronic disks, and other storage devices. The underlying 
network for SSA is a ring network with concurrent access and spatial bandwidth reuse 
' [Y. Ofek, Overview of the MetaRing Architecture, Computer Networks and ISDN 
Systems, VoL 26, Nos. 6-8, March 1994, pp. 817-830], thus, a plurality of end-stations 

1 5 can send data packets to this type shared media network at the same time. 

Fiber Channel (FC) - ANSI X3T1 1, using the arbitrated loop (AL) topology 
(abbreviated FC-AL) as a replacement for Small Computer Storage Interface (SCSI). 
Serial Storage Architecture (SSA) is a standard for peripheral interconnections, bringing 
with it higher levels of performance, availability, fault tolerance, and connectivity at low 

20 cost. FC-AL and SSA are high performance serial interfaces designed to connect disk 
drives, optical drives, tape drives, CD-ROMs, printers, scanners, and other peripherals to 
personal computers, workstations, servers, and storage subsystems. SSA and FC-AL 
facilitate migration from current SCSI equipment and will accommodate implementation 
of future configurations, including the use of fiber-optic connections. 

25 These and other aspects and attributes of the present invention will be discussed 

with reference to the following drawings and accompanying specification. 

In accordance with the present invention, a method is disclosed providing virtual 
pipes that carry streams of real-time traffic to/from Voice over Internet Protocol (VoIP) 
gateways over packet switching networks with timely forwarding and delivery. 

30 Consequently, between any two VoIP gateways the performance parameters, such as, 
loss, delay and jitter, have deterministic guarantees. The method combines the 
advantages of both circuit and packet switching. It provides for allocation for the 
exclusive use of predefined connections and for those connections it guarantees loss 
free transport with low delay and jitter. When predefined connections do not use their 

35 allocated resources, other non-reserved data packets can use them without affecting the 
performance of the predefined connections. 

These and other aspects and attributes of the present invention will be discussed 
with reference to the following drawings and accompanying specification. 
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BRIEF DESCRIPTION OF THE DRAWINGS: ^ 

FIG. 1 is a schematic block diagram of the multiple time base synchronous 

virtual switch of the present invention; 

FIG. 2 is a timing diagram relating the common time reference (CTR) that is 
5 aligned to UTC and super-cycles, time cycles, and multiple sizes of time frames as used 

in the present invention; 

FIG. 3 is a schematic block diagram of a synchronous virtual pipe as used in the 

present invention; 

FIG. 4 is a timing diagram illustrating periodic scheduling and forwarding as 
10 used in the present invention; 

FIG. 5 A is a schematic block diagram of the link layer of a synchronous virtual 
pipe of the present invention; 

• FIG. 5B is a data word encoding table of the present invention; 

FIG. 5C is a control word encoding table of the present invention; 
15 FIG. 6 A is an illustration of the structure of a data packet with header as used in 

the present invention; 

FIG. 6B is an illustration in detail of specific fields in the header of FIG. 6A; 
FIG. 7 is a schematic block diagram of an input port of the multiple time base 
synchronous virtual switch of the present invention; 
20 FIG. 8 is a flow diagram illustrating the operation of the routing controller of the 

present invention; 

FIG. 9 is a schematic block diagram of an output port of the multiple time base 
synchronous virtual pipe switch of the present invention; 

FIG. 10 is a schematic block diagram of the scheduling controller and transmit 
25 buffer of the present invention; 

FIG. 1 1 is a flow diagram illustrating the operation of the scheduling controller 
of the present invention; 

FIG. 12 is a flow diagram illustrating the operation of the select buffer and 
time-driven preemption controller of the present invention; 
30 FIG. 13 is a timing diagram illustrating timely periodic transmission of data 

packets across multiple time bases as in the present invention; 

* FIG. 14 is a flow diagram illustrating additional detail of the operation of the 
scheduling controller of the present invention; 

FIG. 15 is a flow diagram illustrating additional detail of the operation of an 
35 alternate embodiment of the scheduling controller of the present invention; 

FIG. 16 is a schematic block diagram of the shared media network of the present 
invention; 

FIG. 17 is a schematic block diagram of an alternate embodiment of the shared 
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media network of the present invention; ^ 

FIG. 18 is a timing diagram illustrating timely periodic transmission of data 
across the shared media network as in the present invention; 

FIG. 19 is a timing diagram illustrating timely periodic reception of data across 
5 the shared media network as in the present invention; 

FIG. 20 illustrates the protocol used to schedule transmission access to the 
shared media network as used in the present invention; 

FIG. 21 illustrates the protocol used to schedule reception access to the shared 
media network as used in the present invention; 
10 FIG. 22 A is an illustration of the types and organization of data contained within 

the request messages in one embodiment of the present invention; 

FIG. 22B is an illustration of the types and organization of data contained within 
■ the schedule messages in one embodiment of the present invention; 

FIG. 23 is a timing diagram illustrating the end-to-end synchronization within 
15 synchronous virtual pipe as provided by the present invention; 

FIG. 24A is a schematic block diagram of an end-to-end communication 
utilizing the shared media network of the present invention; 

FIG. 24B is a timing diagram illustrating the timely transmission of data in the 
communication shown in FIG. 24A; 
20 FIG. 25A is a timing diagram illustrating the constant data rate requirements of a 

data stream having simple isochronous periodicity; and 

FIG. 25B is a timing diagram illustrating the varying data rate requirements of a 
data stream having complex isochronous periodicity. 

FIG. 26 is a schematic block diagram of a VoIP gateway of the present 
25 invention; 

FIG. 27 is a schematic block diagram of a synchronous virtual pipe interface to a 
VoIP gateway as provided by the present invention; 

FIG. 28 is a timing diagram illustrating processing, assembling of packets of 
digital samples, and on-time transmission of the data packets of the present invention; 
30 FIG. 29 is a timing diagram illustrating the receipt, separation of samples from 

the packet, and other processing of packets of data of the present invention; 

FIG. 30 is a timing diagram illustrating multiplexing of multiple streams or calls 
into one data packet in the present invention; 

FIG. 31 is a timing diagram illustrating demultiplexing of data packets into 
35 multiple streams or calls in the present invention; 

FIG. 32 illustrates both a schematic block diagram of an end-to-end VoIP 
connection and a timing diagram illustrating the timing of same schematic block diagram 
providing synchronized VoIP operation as in the present invention; 
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FIG. 33 is a schematic block diagram of time frame call multiplexing using 
headerless time-based routing of the present invention; 

FIG. 34 is a timing diagram of the headerless time-based routing of the present 
invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMB ODIMENT: 

While this invention is susceptible of embodiment in many different forms, there 
is shown in the drawing, and will be described herein in detail, specific embodiments 
thereof with the understanding that the present disclosure is to be considered as an 
exemplification of the principles of the invention and is not intended to limit the 
invention to the specific embodiments illustrated. 

The present invention relates to a system and method for transmitting and 
.. forwarding packets over a packet switching network. The switches of the network 
maintain a common time reference, which is obtained either from an external source 
(such as GPS — Global Positioning System) oris generated and distributed internally. 
The common time reference is used to define time intervals, which include time 
super-cycles, time cycles, time frames, time slots, and other kinds of time intervals. The 
time intervals are arranged both in simple periodicity and complex periodicity (like 
seconds and minutes of a clock). 

A packet that arrives to an input port of a switch, is switched to an output port 
based on specific routing information in the packet's header (e.g., IPv4 destination 
address in the Internet, VCI/VPI labels in ATM). Each switch along a route from a 
source to a destination forwards packets in periodic time intervals that are predefined 
using the common time reference. Each link connecting switches along the route from 
source to destination may use identical time intervals. Alternatively, each link connecting 
switches along the route from source to destination may use different time intervals 
generated from or otherwise related to the common time reference. 

A time interval duration can be longer than the time duration required for 
communicating a packet, in which case the exact position of a packet in the time interval 
is not predetermined. A packet is defined to be located within the time interval which 
contains the communication of the first bit of the packet, even if the length of the packet 
is sufficiemly long to require multiple time intervals to communicate the entire packet 

Packets that are forwarded inside the network over the same route and in the 
same periodic time intervals constitute a virtual pipe and share the same pipe-ID. A 
pipe-ID can be either explicit, such as a tag or a label that is generated inside the 
network, or implicit such as a group of IP addresses. A virtual pipe can be used to 
transport data packets from multiple sources and to multiple destinations. The time 
interval in which a switch forwards a specific packet is determined by the packet's 
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pipe-ID, the lime it reaches the switch, and the current value of the common time 
reference. 

A virtual pipe provides deterministic quality of service guarantees to the packets 
that are travelling through it. In accordance with the present invention, congestion-free 
5 packet switching is provided for pipe-IDs in which capacity in their corresponding 

forwarding links and time intervals is reserved in advance. Furthermore, packets that are 
transferred over a virtual pipe reach their destination in predefined time intervals, which 
guarantees that the delay jitter or delay uncertainty is smaller than or equal to one time 
interval. 

10 A system is provided for managing data transfer of data packets from a source to 

a destination. The transfer of the data packets is provided during a predefined time 
interval, comprised of a plurality of predefined time frames. The system is further 
, r comprised of a plurality of switches. A virtual pipe is comprised of at least two of the 
switches interconnected via communication links in a path. A common time reference 

15 signal is coupled to each of the switches, and a scheduling controller maps selected 
predefined time frames for transfer into and out from each of the respective switches 
responsive to the common time reference signal. Each communications link may use a 
different time frame duration generated from the common time reference signal. 

Different time frame durations can be required when utilizing communications 

20 links of differing bandwidth or capacity. For example, common communications links 
today include slow links, such as DS1 or Tl that are inherently limited to about 1.5 
Mbit/s of bandwidth, and faster links, such as an OC-3 channel that has 155 Mbit/s of 
bandwidth. A time frame suitable for a Tl link may prove to be interminably long for an 
OC-3 link. Similarly, a time frame duration suitable for an OC-3 link may be too short 

25 to be useful on a Tl link. Similar circumstances arise with any two or more 

communications links of different capacity (e.g., DS0, Tl, T3, OC-3, OC-12, and 
OC^8). 

In general, a slower link speed suggests a longer time frame duration, and a 
faster link speed suggests a shorter time frame duration, but the time frame duration 

30 does not need to be adjusted to meet these suggestions. Any number of links having 
different capacities may share the same time frame duration. Conversely, different time 
frame durations could be selected for various ones of a plurality of links all having the 
same identical bandwidth. The present invention is directed to the case where the time 
frame durations are different on at least two of the communications links, irrespective of 

35 the capacity or available bandwidth of those links. 

For each switch, there is a first predefined time frame within which a respective 
data packet is transferred into the respective switch, and a second predefined time frame 
within which the respective data packet is forwarded out of the respective switch, wherein 
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the first and second predefined time frames may have different durations. The time 
assignment provides consistent fixed intervals between the time between the input to and 
output from the virtual pipe. 

In a preferred embodiment, there is a predefined subset of the predefined time 
5 frames during which the data packets are transferred in the switch, and for each of the 
respective switches, there are a predefined subset of the predefined time frames during 
which the data packets are transferred out of the switch. 

Each of the switches is comprised of one or a plurality of addressable input and 
output ports. A routing controller maps each of the data packets that arrives at each one 
10 of the input pons of the respective switch to a respective one or more of the output ports 
of the respective switch. 

For each of the data packets, there is an associated time of arrival to a respective 
-r one of the input ports. The time of arrival is associated with a particular one of the 
predefined time frames. For each of the mappings by the routing controller, there is an 
15 associated mapping by a scheduling controller, which maps of each of the data packets 
between the time of arrival and forwarding time out The forwarding time out is 
associated with a specified predefined time frame. 

In the preferred embodiment, there are a plurality of the virtual pipes comprised 
of at least two of the switches interconnected via communication links in a path. The 
20 communication link is a connection between two adjacent switches; and each of the 
communications links can be used simultaneously by at least two of the virtual pipes. 
Multiple data packets can be transferred utilizing at least two of the virtual pipes. 

In some configurations of this invention there is a fixed time difference, which is 
constant for all switches, between the time frames for the associated time of arrival and 
25 forwarding time out for each of the data packets. The fixed time difference is a variable 
time difference for some of the switches. A predefined interval is comprised of a fixed 
number of contiguous time frames comprising a time cycle. Data packets that are 
forwarded over a given virtual pipe are forwarded from an output port within a 
predefined subset of time frames in each time cycle. Furthermore, the number of data 
30 packets that can be forwarded in each of the predefined subset of time frames for a given 
virtual pipe is also predefined 

In some other configurations of this invention a virtual pipe can be constructed 
of communication links each with different time frame and/or time cycle duration. 
Furthermore, a communication link can be used by plurality of pipes each with different 
35 time frame duration and/or different time cycle duration. 

The time frames associated with a particular one of the switches within the virtual 
pipe are associated with the same switch for all the time cycles, and are also associated 
with one of input into or output to or from the particular respective switch. Note that 
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each input or output port can be associated with different time frame duration and/or 

different time cycle interval 

In a more general construction of the present invention, a time cycle can be 

constructed of a reoccurring sequence of time frames, where each time frame can have 
5 different time duration. In this case, the time frame duration depends on the time frame 

position within the time cycle. This implies that two consecutive time frames within the 

same time cycle can have different time frame durations. 

In some configurations of this invention there is a constant fixed time between 

the input into and output from a respective one of the switches. This fixed time can 
10 measured by using either the time frame duration on the input link or the time frame 

duration on the output link. Furthermore, this fixed time is reoccurring within each of 

the time cycles. A fixed number of contiguous time cycles comprise a super cycle, 
• which is periodic. Data packets that are forwarded over a given communications link are 

forwarded from an output port within a predefined subset of time frames in each super 
15 cycle. Furthermore, the number of data packets that can be forwarded in each of the 

predefined subset of time frames within a super cycle for a given communications link is 

also predefined. 

In the preferred embodiment the common time reference signal is coupled from 
a GPS (Global Positioning System), and is in accordance with the UTC (Coordinated 

20 Universal Time) standard. The UTC time signal does not have to be received directly 
from GPS. Such signal can be received by a switch by using various means, as long as 
the delay or time uncertainty associated with that UTC time signal does not exceed half 
of the shortest time frame duration that is associated with that switch. 

In one embodiment, the super cycle duration is equal to one second as measured 

25 using the UTC (Coordinated Universal Time) standard. In an alternate embodiment the 
super cycle duration spans multiple UTC seconds. In another alternate embodiment the 
super cycle duration is a fraction of a UTC second. In the most preferred embodiment, 
the super-cycle duration is a small integer number of UTC seconds. 

The communication links can be of fiber optic, copper, and wireless 

30 communication links for example, between a ground station and a satellite, and between 
two satellites orbiting the earth. The communication link between two nodes does not 
have to be a serial communication link. A parallel communication link can be used - 
such link can simultaneously carry multiple data bits, associated clock signal, and 
associated control signals. 

35 The data packets can be Internet protocol (IP) data packets, and asynchronous 

transfer mode (ATM) cells, and can be forwarded over the same virtual pipe having an 
associated pipe identification (PED). The PID can be an Internet protocol (IP) address, 
Internet protocol group multicast address, an asynchronous transfer mode (ATM), a 
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virtual circuit identifier (VCI), and a virtual path identifier (VPI), or (used in combination 
as VCI/VPI). 

The routing controller determines three possible associations of an incoming 
data packet: (1) the output port, (2) the link type, characterized by the time frame, time 
5 cycle and super cycle durations that are" associated with iu and (3) the time of arrival 

(To A). The ToA is then used by the scheduling controller for determining when a data 
packet should be forwarded by the select buffer and time-driven preemption controller 
to the next switch in the virtual pipe. The routing controller utilizes at least one of 
Internet protocol version 4 (IPv4), Internet protocol version 6 (IPv6) addresses, Internet 
10 protocol group multicast address, Internet MPLS (multi protocol label swapping or tag 
switching) labels, ATM virtual circuit identifier and virtual path identifier (VCI/VPI), and 
IEEE 802 MAC (media access control) addresses, for mapping from an input port to an 
7 output port. 

Each of the data packets is comprised of a header, which includes an associated 

1 5 time stamp. For each of the mappings by the routing controller, there is an associated 
mapping by the scheduling controller, of each of the data packets between the respective 
associated time-stamp and an associated forwarding time out, which is associated with 
one of the predefined time frames. The time stamp can record the time in which a packet 
was created by its application. 

20 In one embodiment the time stamp is generated by an Internet real-time protocol 

(RTP), and by a predefined one of the sources or switches. The time stamp can be used 
by a scheduling controller in order to determine the forwarding time of a data packet 
from an output port. 

Each of the data packets originates from an end station, and the time stamp is 

25 generated at the respective end station for inclusion in the respective originated data 

packet. Such generation of a. time stamp can be derived from UTC either by receiving it 
directly from GPS or by using the Internet's Network Time Protocol (NTP). 
Alternatively, the time stamp can be generated at a sub-network boundary or at the 
boundary of the synchronous virtual pipe. 

30 In accordance with the present invention, a system is provided for transferring 

data packets across a data network while maintaining for reserved data traffic constant 
bounded jitter (or delay uncertainty) and no congestion-induced loss of data packets. 
Such properties are essential for many multimedia applications, such as, telephony and 
video teleconferencing. 

35 In accordance with the design, method, and illustrated implementation of the 

present invention, one or a plurality of virtual pipes 25 are provided, as shown in FIG. 3, 
over a data network with general topology. Such data network can span the globe. Each 
virtual pipe 25 is constructed over one or more switches 10, shown in FIG. 3, which are 
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interconnected via communication links 41 in a path. _^ 

FIG. 3 illustrates a virtual pipe 25 from switch A, through switches B and C, and 
ending at switch D. The virtual pipe 25 transfers data packets from at least one source 
to at least one destination. As shown, switch A may accept data from a plurality of 
5 sources via communications links 41. Also as shown, switch D may output data to a 
plurality of destinations via communications links 41. 

The data packet transfers over the virtual pipe 25 via switches 10 are designed to 
occur during a plurality of predefined time intervals, wherein each of the predefined time 
intervals is comprised of a plurality of predefined time frames. The timely transfers of 

1 0 data packets are achieved by coupling a common time reference signal (not shown) to 
each of the switches 10. 

FIG. 1 is a schematic block diagram of the multiple frame duration synchronous 
-r virtual pipe (SVP) switch 10 of the present invention. The SVP switch 10 comprises a 
common time reference means 20, at least one input port 30, at least one output port 40, 

15 and a switching fabric 50. In the preferred embodiment, the common time reference 

means 20 is a GPS receiver that receives a source of common time reference 001 (e.g., 
UTC via GPS) via an antenna as illustrated. The common time reference means 20 
provides a common time reference signal 002 to all input ports 30 and all output ports 
40. GPS time receivers are available from variety of manufacturers, such as, TrueTime, 

20 Inc. (Santa Rosa, CA). With such equipment, it is possible to maintain a local clock 

with accuracy of ±1 microsecond from the UTC (Coordinated Universal Tune) standard 
everywhere around the globe. 

Each respective one of the input ports 30 is coupled to the switching fabric 50. 
Each respective one of the output ports 40 is coupled to the switching fabric 50. 

25 The SVP switch 10 of FIG. 1 is also coupled to one or more communications 

links 41 by way of input and output ports 30 and 40, respectively. The communications 
links 41 can be implemented within an IP network. 

In the present invention, the communications links 41 need not share the same 
time frame duration. Each of the communications links 41 may have a time frame of a 

30 different duration. As illustrated in FIG. 1, some of the communications links have a 
time frame duration of TF1, and some others of the communications links have a time 
frame duration of TF2. The present invention is not limited to two different time frame 
durations. Any number of different time frame durations may be accommodated by the 
multiple frame duration SVP switch of the present invention. 

35 FIG. 2 is a timing diagram relating the common time reference (CTR) that is 

aligned to UTC and super-cycles, time cycles, and multiple sizes of time frames as used 
in the present invention. The lop horizontal axis details the timing of a communications 
link employing a first time frame duration. The bottom horizontal axis details the timing 
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of a communications link employing a second time frame duration. Both axes are 
plotted with respect to the same common time reference. 

As shown in FIG. 2, the communications link employing the first time frame 
duration comprises 80 time cycles within each super-cycle, with the time cycles 
5 numbered 0 through 79. Within each of the time cycles are 100 time frames of duration 
TF1, numbered 1 through 100. The duration of the time frame TF1 is selected to be 
125 microseconds, thus determining a time cycle to be 12.5 milliseconds and a 
super-cycle of exactly one UTC second. 

As shown in FIG. 2, the communications link employing the second time frame 

10 duration comprises 80 time cycles within each super-cycle, with the time cycles 

numbered 0 through 79. Within each of the time cycles are 25 time frames of duration 
TF2, numbered from 1 through 25. The duration of the time frame TF2 is selected to 
- be 500 microseconds, thus determining a time cycle to be 12.5 milliseconds and a 
super-cycle of exactly one UTC second. 

1 5 For scheduling of data transfer between two communications links, it is 

obviously most convenient if they share the same time frame duration. If they have 
different time frame durations, it is convenient to pick those durations and numbers of 
time frames per time cycle so that they share the same time cycle duration and 
super-cycle duration (as in the example shown in FIG. 2). If two communications links 

20 have different time frame durations and different time cycle durations, the respective 
durations and numbers of time frames and time cycles within a super-cycle should be 
selected to permit both communications links to share the same overall super-cycle 
duration. 

FIG. 2 also illustrates how the common time reference signal can be aligned with 
25 the UTC (Coordinated Universal Time) standard. In this illustrated example, the 

duration of every super-cycle is exactly one second as measured by the UTC standard. 

Moreover, as shown in FIG. 2 the beginning of each super-cycle coincides with the 

beginning of a UTC second. Consequently, when leap seconds are inserted or deleted 

for UTC corrections (due to changes in the earth rotation period) the cycle and 
30 super-cycle periodic scheduling will not be affected. The time frames, time cycles, and 

super-cycles are associated in the same manner with all respective switches within the 

virtual pipe at all times. 

In the embodiment illustrated in FIG. 2, the super-cycle duration is equal to one 

second as measured using the UTC (Coordinated Universal Time) standard. In an 
35 alternate embodiment the super-cycle duration spans multiple UTC seconds. In another 

alternate embodiment the super-cycle duration is a fraction of a UTC second. In the 

most preferred embodiment, the super-cycle duration is a small integer number of UTC 

seconds. 
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Pipeline forwarding relates to data packets being forwarded across a virtual pipe 
25 with a predefined delay in every stage (either across a communication link 41 or 
across a switch 10 from input port 30 to output port 40). Data packets enter a virtual 
pipe 25 from one or more sources and are forwarded to one or more destinations. 

5 Referring to FIG. 3, the timely pipeline forwarding of data packets over the 

virtual pipe 25 is illustrated. In this example, time cycles each uniformly contain 10 time 
frames, and for clarity the super-cycles are not shown. A data packet is received by one 
of the input ports 30 of switch A at time frame l t and is forwarded along this virtual pipe 
25 in the following manner (i) the data packet 41A is forwarded from the output port 40 

10 of switch A at time frame 2 of time cycle 1, (ii) the data packet 41B is forwarded from 

the output port 40 of switch B, after 18 time frames, at time frame 10 of time cycle 2, (iii) 
the data packet 41C is forwarded from the output port 40 of switch C, after 42 time 
■ frames, at time frame 2 of time cycle 7, and (iv) the data packet 41D is forwarded from 
the output port 40 of switch D, after 19 time frames, at time frame 1 of time cycle 9. 

15 As illustrated in FIG. 3, 

• All data packets enter the virtual pipe 25 (i.e., forwarded out of the output port 
40 of switch A) periodically at the second time frame of a time cycle, are output 
from this virtual pipe 25 (i.e., are forwarded out of the output port 40 of switch 
D) after 79 time frames. 

20 • The data packets that enter the virtual pipe 25 (i.e., forwarded out of the output 

port 40 of switch A) can come from one or more sources and can reach switch 
A over one or more input links 41. 

• The data packets that exit the virtual pipe 25 (i.e., forwarded out of the output 
port 40 of switch D) can be forwarded over plurality of output links 41 to one of 

25 plurality of destinations. 

• The data packets that exit the virtual pipe 25 (Le., forwarded out of the output 
port 40 of switch D) can be forwarded simultaneously to multiple destinations, 
(i.e., multi-cast (one-to-many) data packet forwarding). 

• The communication link 41 between two adjacent ones of the switches 10 can 
30 be used simultaneously by at least two of the virtual pipes. 

• A plurality of virtual pipes can multiplex (Le., mix their traffic) over the same 
communication links. 

• A plurality of virtual pipes can multiplex (i.e., mix their traffic) during the same 
time frames and in an arbitrary manner. 

35 • The same time frame can be used by multiple data packets from one or more 

virtual pipes. 

For each virtual pipe there are predefined time frames within which respective 
data packets are transferred into its respective switches, and separate predefined time 
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frames within which the respective data packets are transferred out of its respective 
switches. Though the time frames of each virtual pipe on each of its switches can be 
assigned in an arbitrary manner along the common time reference, it is convenient and 
practical to assign time frames in a periodic manner in time cycles and super-cycles. 

The switch 10 structure, as shown in FIG. 1, can also be referred to as a pipeline 
switch, since it enables a network comprised of such switches ta operate as a large 
distributed pipeline structure, as it is commonly found inside digital systems and 
computer architectures. 

FIG. 4 illustrates the mapping of the time frames into and out of a node on a 
virtual pipe, wherein the mapping repeats itself in every time cycle illustrating the time in, 
which is the time of arrival (ToA), versus the time out, which is the forwarding time out 
of the output port. FIG. 4 thereby illustrates the periodic scheduling and forwarding 
• timing of a switch of a virtual pipe wherein there are a predefined subset of time frames 
(/, 75, and 80) of every time cycle, during which data packets are transferred into that 
switch, and wherein for that virtual pipe there are a predefined subset time frames (j+3, 
1, and 3) of every time cycle, during which the data packets are transferred out of that 
switch. 

In the illustrated example of FIG. 4, a first data packet 5a arriving at the input 
port of the switch at time frame j is forwarded out of the output port of the switch at time 
frame i+3. In this example the data packet is forwarded out of the output port at a later 
time frame within the same time cycle in which it arrived. The delay in transiting the 
switch, dts, determines a lower bound on the value (i+dts). In the illustrated example, 
dts must be less than or equal to 3. 

.Also as shown in FIG. 4, a second data packet 5b arriving at the input port of the 
switch at time frame 75 is forwarded out of the output port of the switch at time frame 1 
within the next time cycle. In this example the data packet is forwarded out of the output 
port at a earlier numbered time frame but within the next time cycle from which it 
arrived. Note that data packets in transit may cross time cycle boundaries. 

If — for example — each of the three data packets has 125 bytes (i.e. 1000 bits), 
and there are 80 time frames of 125 microseconds in each time cycle (Le. a time cycle 
duration of 10 milliseconds), then the bandwidth allocated to this virtual pipe is 300,000 
bits per second. In general, the bandwidth or capacity allocated for a virtual pipe is 
computed by dividing the number of bits transferred during each of the time cycles by 
the time cycle duration. In the case of a bandwidth in a super-cycle, the bandwidth 
allocated to a virtual pipe is computed by dividing the number of bits transferred during 
each of the super-cycles by the super-cycle duration. 

Each switch 10 is comprised of a plurality of addressable input ports 30 and 
output ports 40. As illustrated in FIG. 7, the input port 30 is further comprised of a 
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routing controller 35B for mapping each of the data packets that arrives^! each one of 
the input ports to a respective one of the queue to the output ports. As illustrated in 
FIG. 9, the output port 40 is further comprised of a scheduling controller and transmit 
buffer 45. 

5 An output port 40 is connected to a next input port 30 via a communication link 

41, as shown in FIGS. 3 and 5 A. The communication link can be realized using various 
technologies compatible with the present invention including fiber optic conduits, copper 
and other wired conductors, and wireless communication links — including but not 
limited to, for example, radio frequency (RF) between two ground stations, a ground 

10 station and a satellite, and between two satellites orbiting the earth, microwave links, 
infrared (IR) links, optical communications lasers. The communication link does not 
have to be a serial communication link. A parallel communication link can be 
•used — such a parallel link can simultaneously carry multiple data bits, associated clock 
signals, and associated control signals. 

15 As shown in FIG. 1, the common time reference 002 is provided to the input 

ports 30 and output ports 40 (comprising the input/output ports 30/40) from the GPS 
time receiver 20, which receives its timing signal from the GPS antenna 001. GPS time 
receivers are available from variety of manufacturers, such as, TrueTime, Inc. (Santa 
Rosa, CA). With such equipment, it is possible to maintain a local clock with accuracy 

20 of ±1 microsecond from the UTC (Coordinated Universal Tune) standard everywhere 
around the globe. 

FIG. 5A is an illustration of a serial transmitter and a serial receiver. FIG. 5B is 
a table illustrating the 4B/5B encoding scheme for data, and FIG. 5C is a table 
illustrating the 4B/5B encoding scheme for control signals. 

25 Referring to FIG. 5A, a serial transmitter 49 and serial receiver 31 are illustrated 

as coupled to each link 41. A variety of encoding schemes can be used for a serial line 
link 41 in the context of this invention, such as, SONET/SDH, 8B/10B Fiber Channel, 
and 4B/5B Fiber Distributed Data Interface (FDDI). In addition to the encoding and 
decoding of the data transmitted over the serial link, the serial transmitter/receiver (49 

30 and 31) sends/receives control words for a variety of in-band control purposes, mostly 
unrelated to the present invention description. 

However, one control word, time frame delimiter (TFD), is used in accordance 
with the present invention. The TFD marks the boundary between two successive time . 
frames and is sent by a serial transmitter 49 when a CTR 002 clock tick occurs in a way 

35 that is described hereafter as part of the output port operation. 

It is necessary to distinguish in an unambiguous manner between the data words, 
which carry the information, and the control signal or words (e.g., the TED is a control 
signal) over the serial link 41. There are many ways to do this. One way is to use the 
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known 4B/5B encoding scheme (used in FDDI). In this scheme, every 8-bit character 
is divided into two 4-bit parts and then each part is encoded into a 5-bit codeword that 
is transmitted over the serial link 41. 

In a preferred embodiment the serial transmitter 49 and receiver 31 comprise 
5 AM7968 and AM7969 chip sets, respectively, both manufactured by AND Corporation. 

FIG. 5B illustrates an encoding table from 4-bit data to 5-rbit serial codeword. 
The 4B/5B is a redundant encoding scheme, which means that there are more codeword 
than data words. Consequently, some of the unused or redundant serial codeword can 
be used to convey control information. 

10 FIG. 5C is a table with 15 possible encoded control codeword, which can be 

used for transferring the time frame delimiter (TFD) over a serial link. The TFD 
transfer is completely transparent to the data transfer, and therefore, it can be sent in the 
middle of the data packet transmission in a non-destructive manner. 

When the communication links 41 are SONET/SDH, the time frame delimiter 

15 cannot be embedded as redundant serial codeword, since SONET/SDH serial encoding 
is based on scrambling with no redundancy. Consequently, the TFD is implemented 
using the SONET/SDH frame control fields: transport overhead (TOH) and path 
overhead (POH). Note that although SONET/SDH uses a 125 microseconds frame, it 
cannot be used directly in accordance with the present invention, at the moment, since 

20 SONET/SDH frames are not globally aligned and are also not aligned to UTC. 

However, if SONET/SDH frames are globally aligned, SONET/SDH can be used 
compatibly with the present invention. 

FIG. 7 is a schematic block diagram of an input port with a routing controller. 
As shown in FIG. 7, the input port 30 has several parts including: serial receiver 31, a 

25 routing controller 35 and separate queues to the output ports 36. The serial receiver 31 
transfers the incoming data packets and the time frame delimiters to the routing 
controller 35. 

The controller 35 comprises a routing controller 35B that is constructed of a 

central processing unit (CPU), a random access memory (RAM) for storing the data 
30 packet, read only memory (ROM) for storing the routing controller processing program; 

and a routing table 35D that is used for determining the output port that the incoming 

data packet should be switched to. 

Referring simultaneously to both FIGS. 17 and 19, FIG. 19 illustrates the timing 

associated with the reception data packets of the present invention. The shared media 
35 access time manager 100 is responsive to receipt of data packets from a synchronous 

virtual pipe 41 via an input port 30. The data packets are transmitted to arrive lc at the 

access time manager 100 regularly at predefined time frames in each time cycle, which is 

just after time frame 2 in the illustrated example. 
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The access time manager 100 is responsible for scheduling data packets arriving 
from the synchronous virtual pipe 41 via the input port 30 to be transmitted via the 
shared media network 200 to arrive at the shared media network end-stations 300 during 
particular time frames within a time cycle. The data packets are transmitted at time Id to 
5 arrive at the end-station. - 

The access time manager 100 reserves time frames and schedules itself to 
continue to transmit data packets starting at the same time frame within each time cycle. 
After each additional data packet 2c, 3c, is received by the access time manager 100, it is 
transmitted 2d, 3d to the appropriate end-station 300 via the shared media network 200 

10 at a consistent scheduled respective time frame. 

The regularity of arriving data at the same time frame of each time cycle provides 
for uninterrupted receipt of digital data at the end-stations 300. Hie jitter present in the 
- r received data packet arrival times is controlled by the common time reference to be small 
and well-bounded. In another embodiment of this invention, a data packet that arrives at 

15 the shared media network can be scheduled to be forwarded to multiple end-station 
either simultaneously at the same schedule or at multiple schedules. 

The SMATM has a sub-component for processing a plurality of format types of 
data packets 100A. This sub-component converts from a first format types of data 
packets to a second format types of data packets. The first and second format types can 

20 be one of: ATM, IP, fiber channel for FC-AL, SS A, DOCSIS, IEEE 802. 14, and IEEE 
802. 1 1 . This sub-component 100A is also capable of converting format types of data 
packets of different sizes, thus the number of transmission schedules over the shared 
media network can be different than the number of transmission schedules over the 
point-to-point network in the synchronous virtual pipe (S VP). More specifically, if 

25 within a time cycle and a super cycle there are: (1) a first number of schedules for the 
transmission of data packets of the first format type and (2) a second number of 
schedules for the transmission of data packets of the second format type; then the sub- 
component 100A by means of a predefined scheduling table converts: (1) the first 
number of schedules to the second number of schedules and (2) the second number of 

30 schedules to the first number of schedules. 

The SMATM has a sub-component 100B for regulating the data packet flow to 
and from the shared media network by using a scheduling controller and transmit buffer 
100B; this component is implemented as previously described component 45 in FIG. 
10. The sub-component 100B uses four parameters: (1) the pipe-ID (PED), (2) the time 

35 stamp in the data packet header, (3) the common time reference, and (4) the time of 
arrival (TO A) attached by the SMATM to the incoming data packets from the shared 
media network and from SVP. Using these parameters sub-component 100B assigns 
selected predefined time frames for synchronously transmitting data packets over the 
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synchronous virtual pipe and the shared media network. 

Referring simultaneously to both FIGS. 17 and 20, FIG. 20 shows the protocol 
used to set up a schedule of periodic transmissions from an end-station 300 to the 
access time manager 100 for subsequent forwarding a synchronous virtual pipe 41 in 
the preferred embodiment of the present invention. The end-station 300 that operates as 
an access time responder issues a request la to the access time manager 100. The 
request la describes the nature of the data to be transmitted and the destination, 
permitting the access time manager 100 to determine what parameters (e.g., periodicity, 
reserved time frames, etc.) needs to be scheduled to fulfill the request 

Upon determining a schedule suitable to satisfy request la, the access time 
manager issues a response 2b to the access time responder which describes to the 
corresponding end-station the parameters (e.g., periodicity, reserved time frames, etc.) 
bave been reserved for its use. These parameters are issued with respect to a common 
time reference (CTR) 002 shared by all end-stations 300 and the access time manager 
100 via the shared media network 200. 

Note that in one embodiment the request la and the response 2b may occur 
during a time interval scheduled by the access time manager specifically for use in 
negotiating requests. In an alternate embodiment, either or both of request la and 
response 2b may occur during other times such as permitted by the existing schedules, 
maintained by the access time manager 100 for shared media network 200. 

Upon receipt of the response 2b, the end-station access time responder is then 
permitted to transmit, at the indicated intervals, data packets to be forwarded to a 
synchronous virtual pipe. In the illustrated example, the access time responder has been 
scheduled to transmit data packets on the shared media network 200 at times lc, 2c, 3c, 
and 4c The access time manager 100 accepts data packets from the shared media 
network 200, and then forwards corresponding data packets via the synchronous virtual 
pipe 41 at times Id, 2d, 3d, and 4d, respectively. The times 1c, 2c, 3c, 4c, Id, 2d, 3d, 
and 4d are all defined with respect to the common time reference signal. In another 
embodiment of this invention, the access time manager 100 accepts data packets in 
multiple parts (e.g., some cable modem protocols) from the shared media network 200, 
assembles the multiple parts into data packets, and performs any other processing 
necessary for the request, and then forwards corresponding data packets via the 
synchronous virtual pipe 41. 

In another embodiment of this invention, there are two distinct data packet 
formats: one over SVP (e.g., IP), and the other over the shared media network. The data 
packet formats over the shared media networks correspond to the specific shared media 
protocol. In such cases, the access time manager additionally performs the necessary 
data packet format conversion. 
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In a preferred embodiment, the access time manager 100 provides a response 2b 
that describes an isochronous channel on the shared media network 200. An 
isochronous channel is one that provides for periodic reserved transmission of data on a 
shared media. The isochronous periodicity may be simple or complex. Simple 
5 isochronous periodicity provides for consistent, regular transmissions of same-sized 
groups of data. Complex isochronous periodicity permits irregular but defined 
transmissions of more than one differently sized groups of data at some regular interval. 

FIG. 25 A is an illustration of the data requirements for simple isochronous 
periodicity. In this illustrated example, data is provided in a single fixed amount at a 
1 0 periodic interval. Referring back to FIG. 20, in the example of FIG. 25 A the access time 
manager 100 would schedule simple isochronous periodic transmissions at times 1c, 2c, 
3c, and 4c to be of fixed and equal duration, and thus fixed and equal amounts of data 
for each transmission. 

FIG. 25B is an illustration of the data requirements for complex or irregular 
1 5 isochronous periodicity. In this illustrated example, data is provided in two different 
amounts at a periodic interval, corresponding to a repeating pattern of I- frames and P- 
frames. The data requirements as shown are very common for compressed video data 
sources. As shown in this example, the pattern of one I-frame and several P-frames 
repeats once per super-cycle, although in practice the pattern may repeat at a different 
20 interval. The amount of data required for an I-frame is significantly higher than the 
amount of data required for each of the P-frames. As a result, this data transmission 
pattern has complex isochronous periodicity, requiring above-average amounts of data at 
some intervals (i.e., the I-frame in each super-cycle) and average amounts of data at 
more frequent intervals (i.e., the plurality of P-frames in each super-cycle). Referring 
25 back to FIG. 20, in the example of FIG. 25B the access time manager 100 would 

schedule complex isochronous periodic transmissions such that the transmission time 
allocated on the shared media network 200 at time 1c would be greater than the 
transmission time allocated on the shared media network at times 2c, 3c, and 4c 

The following is a simple numerical example for complex periodicity scheduling 
30 with compressed video sources, such as MPEG (familiarity with which is assumed 
below), in the following way: 

Let the video-frame rate be 20 video frames per second or every 50 ms 

Let Tf be lms 

Let k=50 and the time cycle be 50 ms 
35 Let the size of each I video-frame be bounded by lOOKBytes and the size of the 

P video-frames be bounded by lOKBytes. 

Assume that an I video-frame is followed by five P video-frames. 

Next, create a super-cycle of 6 time cycles, each time cycle has 50 time frames. 
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The complex periodicity forwarding can be done in the following manner 

Step 1 : The video stream is divided into 2Kbytes data packets. 

Step 2: The I video-frame is divided into 50 packets which are sent in 50 
predefined time frames in time cycle number one. 
5 Step 3: Each of the P video-frames is sent in 5 predefined time frames in each of 

the following 5 time cycles. 

Step 4: GOTO Step 1 and repeat the six time cycles pattern. 

In another preferred embodiment, the access time manager 100 provides in 
addition to the schedule message response 2b specific TICK signals, It, 2t, 3t, 4t, in 
10 FIG. 20, indicating the specific transmission time by the end-station (on access time 

responder). Consequently, the transmission lc, 2c, 3c, and 4d are in response to TICK 
signals It, 2t, 3t, and 4t, respectively, as shown in FIG. 20. In such an embodiment, the 
isochronous channel across the shared media network 200 is actually created by the 
access time manager 100. Again, the isochronous channel is one that provides for 
15 periodic reserved transmission of data on a shared media network with either simple or 
complex periodicity. 

Referring simultaneously to both FIGS. 17 and 21, FIG. 21 shows the protocol 
used to set up a schedule of periodic transmissions from a synchronous virtual pipe 41 
to an end-station 300 via the access time manager 100 in the preferred embodiment of 
20 the present invention. The end-station 300 that operates as an access time responder 

issues a request Ig to the access time manager 100. The request lg describes the nature 
of the data to be received and the source, permitting the access time manager 100 to 
determine what parameters (e.g., periodicity, reserved time frames, etc.) needs to be 
scheduled to fulfill the request. 
-5 Upon determining a schedule suitable to satisfy request lg, the access time . 

manager issues a response 2h to the access time responder which describes to the 
corresponding end-station the parameters (e.g., periodicity, reserved time frames, etc.) 
have been reserved for the respective source. These parameters are issued with respect 
to a common time reference (CTR) 002 shared by all end-stations 300 and the access 
30 time manager 100 via the shared media network 200. 

Note that in one embodiment the request lg and the response 2h may occur 
during a time interval scheduled by the access time manager specifically for use in 
negotiating requests. In an alternate embodiment, either or both of request lg and 
response 2h may occur during other times such as permitted by the existing schedules 
35 maintained by the access time manager 100 for shared media network 200. 

Upon receipt of the response 2h, the end-station access time responder is then 
responsive to receive, at the indicated intervals, data forwarded from the synchronous 
virtual pipe 41 via the access time manager 100. In the illustrated example, the access 
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time responder has been scheduled to receive data on the shared media network 200 at 
rimes If, 2f t 3f, and 4f. The access time manager 100 accepts data packets from the 
synchronous virtual pipe 41 at times le, 2e, 3e, and 4e, separates the data from those 
accepted data packets and/or performs any other processing as necessary to support the 
5 request, and forwards the corresponding-data via the shared media network 200 to the 
end-station access time responder at times If, 2f, 3f, and 4f, respectively. The times le, 
2e, 3e, 4e, If, 2f, 3f, and 4f are all defined with respect to the common time reference 
signal. 

In a preferred embodiment, the access time manager 100 provides a response 2h 

1 0 that describes an isochronous channel on the shared media network 200. An 

isochronous channel is one that provides for periodic reserved transmission of data on a 
shared media. The isochronous periodicity may be simple or complex. 
- Referring again to FIG. 25A with respect to FIG. 20, in the example of FIG. 

25 A the access time manager 100 would schedule simple isochronous periodic 

i 5 transmissions at times If, 2f, 3f, and 4f to be of fixed and equal duration, and thus fixed 
and equal amounts of data for each transmission. 

Referring again to FIG. 25B with respect to FIG. 20, in the example of FIG. 
25B the access time manager 100 would schedule complex isochronous periodic 
transmissions such that the transmission time allocated on the shared media network 

20 200 at time If would be greater than the transmission time allocated on the shared media 
network at times 2f, 3f, and 4f. 

FIG. 22 A is an illustration of the types and organization of data contained within 
the request messages in one embodiment of the present invention. Specifically, it 
illustrates the format of the requests la of FIG. 20 and lg of FIG. 21. The example 

25 request as shown contains fields indicating sender identification, device identification, 

device type, resource description, and request description. The sender identification may 
be used to identify which of the plurality of end-stations 300 is making the request The 
device identification may be used to provide sub-addressing within the access time 
responder, thus supporting a plurality of co-located devices at the selected end-station. 

30 The device type and request description provide further information about the source 

and/or destination, and the requested schedule of data transfer, including but not limited 
to the total duration of the transfer, the total size of the transfer, the permitted granularity 
of the transfer, an indication of whether the data is expected to be bursty in nature, the 
peak, average, and lowest data rate requirements, the periodicity of the data, and an 

35 indication if extended request information is supplied. Extended request information 
may be used to further detail and describe the requested data transfer beyond the fields 
indicated in FIG. 22A. 

FIG. 22B is an illustration of the types and organization of data contained within 
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the schedule messages in one embodiment of the present invention. Specifically, it 
illustrates the format of the schedule responses 2b of FIG. 20 and 2h of FIG. 21. The 
example request as shown contains fields indicating sender identification, device 
identification, device type, and schedule description. The sender identification, device 
identification, and device type parallel the corresponding entries in the requests la and 
lg, respectively, as described above. The schedule description inqludes, but is not 
limited to, detailed information regarding the time frames and transmission durations 
that have been reserved to support the request made by the access time responder. The 
transmission durations may be referenced in terms of bytes transferred. Alternatively, 
the transmission durations may be referenced in terms of time frames, fractions of time 
frames, absolute time duration, and so forth. In any alternative, the information 
contained in the schedule message as shown in FIG. 22B provides information to the 
-access time responder as to which time intervals are available in the shared media 
network 200 for its exclusive use to support the request In the example shown in FIG. 
22B, the schedule response includes a series l.„k of schedule sets, wherein each 
schedule set is comprised of an indication of a specific time frame (e.g., tl, t2, t3, . . . tk) 
within a cycle or a super-cycle, along with an indication of the number of bytes"(e.g., si, 
s2, s3, . . . sk) that can be transferred within that time frame. 

FIG. 23 is a timing diagram illustrating the end-to-end synchronization within 
synchronous virtual pipe as provided by the present invention. In the specific example 
as shown in FIG. 23, a video frame is shown to be transferred from end-to-end in 
synchronization with a common time reference (e.g., UTC from GPS), but it is to be 
understood that FIG. 23 is only an example and the invention is not limited to the end- 
to-end synchronized transfer of video frames. As shown in FIG. 23, and end-station 
Sender is located on a first shared media network. The end-station Sender captures a 
video frame at time la and provides any processing required to convert the video frame 
into a form suitable for direct digital transfer over a synchronous digital network. The 
details of such processing are well-known in the art and lie outside of the novelty of the 
present invention and thus will not be detailed herein. 

The end-station Sender then transmits the data representing the video frame to 
the shared media network Node B at time frame lb. The transmission from Sender to 
Node B is scheduled apriori by interaction between Sender and Node B as shown in 
FIG. 20 and discussed above. The data comprising transmission lb is assembled into 
one or more associated data packets within the shared media network Node B. 

The shared media network Node B forwards the data packet(s) through the 
synchronous virtual pipe connecting Node B to shared media network Node C at time 
frame lc The transmission from Node B to Node C is scheduled apriori by interaction 
between Node B and Node C as part of the operation of setting up a synchronous 
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virtual pipe, which lies outside of the novelty of the present invention and thus will not 
be detailed herein. Note that as shown in FIG. 3, one synchronous virtual pipe may 
span a path containing a plurality of interconnected SVP switches 10 (e.g., A, B, C, D). 
The shared media network Node C then forwards the data contained in the data 

5 packet(s) received at time frame 1c from" shared media network Node C to end- station 
Receiver at time frame Id. The transmission from shared media network Node G to 
end-station Receiver is scheduled apriori by interaction between Node C and end- 
station Receiver as shown in FIG. 21 and discussed above. The end-station Receiver 
accepts the video frame data at time le and provides any processing required to convert 

10 the video frame data into a form suitable for display. The details of such processing are 
well-known in the art and lie outside of the novelty of the present invention and thus will 
not be detailed herein. 

' As shown in FIG. 23, a plurality of individual end-to-end transmissions may be 

in progress at any given time. In the example illustrated, during the time cycle 

15 containing time frame Id, the end-station Sender may process a second video frame at 
time frame 2a, and thus relay the processed second video frame to the shared media 
network Node B at time frame 2b. The present invention supports simultaneous 
pipelined synchronous operation such that, for example, time frames 2b and Id may 
represent the same time frame numbers. It is to be understood that any number of 

20 simultaneous end-to-end transfers may be underway at the same time, subject to 

scheduling constraints due to bandwidth availability, which is clearly known apriori. 
Further, it is to be understood that because the schedules are established apriori, the 
indicated pipelined end-to-end operation is free of the problems inherent in the prior art 
regarding congestion and jitter. 

25 FIG. 24A is a schematic block diagram of an end-ttf-end communication 

utilizing the shared media network of the present invention, and thus details another 
aspect of the end-to-end communication as shown in FIG. 23 and described above. In 
FIG. 24 A, links 301 from a plurality of end-stations 300 (not shown) are coupled to the 
shared media network 200. The shared media network 200 is coupled via link 101 to 

30 the access time manager 100, which comprises part of the shared media network B of 
the present invention. The shared media network B additionally comprises an SVP 
switch 10 which further additionally comprises an output port 40. The shared media . 
network B is linked via a synchronous virtual pipe 25 to an input port 30 of the shared 
media network D, by way of any number of interstitial SVP switches (e.g., C) and links 

35 41. Note that as shown in FIG. 3 and previously described, one synchronous virtual 
pipe 25 may span a path containing a plurality of interconnected SVP switches 10. 

FIG. 24B is a timing diagram illustrating the timely transmission of data in the 
communication path shown in FIG. 24A, with the time axis directed downwards as 
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shown. Video frames are captured at times 1V/P, 2V/P, and 3V/P and the data 
representative of the video frames are transported through the shared media network 200 
to the shared media network B as shown in the figure. Tunes 1V/P, 2V/P, and 3V/P are 
scheduled in advance using the protocol as shown in FIG. 20 and discussed above. 
5 Data packets containing data representative of video frames are then relayed via the 

synchronous virtual pipe 25 at scheduled times 1BCD, 2BCD, and 3BCD (respectively) 
to shared media network D. The data representative of video frames are then relayed 
during times 1P/V, 2P/V, and (not shown) 3P/V, respectively, to an end-station 
connected to one of the shared media networks available via shared media network D. 

10 

PACKET TELEPHONE SCHEDULING WITH DIFFERENT TIME 
INTERVALS 

FIG. 26 is a schematic description VoIP gateway (GW) with streaming of digital 

15 samples in which the following functions are performed in its packeting subsystem 
controller 81: (1) packetization (assembly of digital samples into data packets) and 
depacketization (separation of digital samples from data packets), (2) echo cancellation, 
and (3) compression and decompression. The controller 81 is constructed of a central 
processing unit (CPU), a random access memory (RAM) for storing the data packets 

20 and digital samples, a read only memory (ROM) for storing the controller processing 
program, and a table with forwarding and operation parameters. The packeting 
subsystem controller 81 is coupled to a synchronous virtual pipe (S VP) switch 10. The 
controller 81 is also coupled via digital sample input links 82 and digital sample output 
links 83 to external voice, video, and other devices (not shown). 

25 The S VP switch 10 of FIG. 26 is also coupled to one or more synchronous 

virtual pipes 41 by way of combination input/output ports 30/40. The synchronous 
virtual pipes 41 can be implemented within an IP network. 

The SVP switch 10 of FIG. 26 is further comprised of a GPS receiver 20 linked 
via a common time reference (CTR) signal 002 to each of the input/output ports 30/40. 

30 In this manner, a common time reference is supplied to each of the input pons and each 
of the output ports within the SVP switch 10. The CTR signal 002 is also coupled to 
the controller 81 as shown in the figure. 

FIG. 27 is a schematic block diagram of a synchronous virtual pipe interface to a 
VoIP gateway as provided by the present invention, illustrating detail of an alternate 

35 embodiment In this embodiment, the SVP switch 10 additionally comprises a switching 
fabric 50 which is coupled to one or more input ports 30 and one or more output ports 
40. Each of the input ports 30 is coupled to the switch fabric 50 via links 37, as shown 
in FIG. 7. Each of the output ports 40 is coupled to the switch fabric 50 via links 51 as 
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shown in FIG. 9. The switch fabric is inherently coupled and integrated (not shown) to 
the controller 81. Each pair of respective input port 30 and output port 40 comprise an 
input/output port 30/40. As shown in FIG. 27, the common time reference (CTR) signal 
002 is coupled to each input port 30, each output port 40, and to the controller 81. The 

5 controller 81 is also coupled via digital sample input links 82 and digital sample output 
links 83 to external voice devices (not shown). 

In yet another alternate embodiment, the operation of collection and assembly of 
data packets may additionally comprise the method of data compression, wherein the 
digital samples are compressed to further reduce the data packet bandwidth, or to reduce 

10 the data packet size required. In some cases the compression operation is performed on 
a group of block of digital samples with a predefined size or duration. In the case of 
data originating as visual (e.g. video signals), the compression operation may be 
■performed on a group of block of digital samples within a predefined image region, size, 
or duration. 

15 As shown in FIG. 28, the data packet is then transmitted lb via the SVP switch 

10 to a synchronous virtual pipe during a predefined time frame. In the illustrated 
example, the set of digital samples assembled into a data packet are transmitted lb 
starting at time frame 1 of time cycle 1. The transmission lb occurs simultaneously 
with the start of the operation of collection and assembly of data packet 2a, and the 

20 process repeats in time for subsequent time cycles. 

FIG. 28 shows the timing of the regular collection and assembly of data packets 
and virtually immediate transmission of the data packet of digital samples of the present 
invention. Data packets are scheduled for immediate transmission within reserved time 
frames, thus congestion and routing latency within the initiating VoIP gateway are 

25 eliminated in the present invention. 

FIG. 29 is a timing diagram illustrating the receipt, separation of digital samples 
from the data packets, and other processing of data packets of the present invention. 
The controller 81 is responsive to receipt of data packets comprising digital samples 
from a synchronous virtual pipe. The data packets arrive regularly Id at a predefined 

30 time frame in each time cycle, which is time frame 2 in the illustrated example. The 
separation le of digital samples from the data packets is scheduled within the VoIP 
gateway of the present invention to immediately separate the digital samples from the 
data packet thus providing an output of digital samples. The output of digital samples is 
then relayed to an external device, which in the preferred embodiment for analog 

35 telephone is a digital to analog converter. 

The regularity of arriving data packets at the same time frame of each time cycle 
provides for uninterrupted receipt of packets of digital samples, which in turn provides 
for uninterrupted receipt of digital samples at the digital to analog converter. The jitter 
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present in the received data packet arrival times is controlled by the common time 
reference to be very small and well-bounded Because the separation of digital samples 
from a data packet can be scheduled to occur as soon as the data packet arrives at the 
VoIP gateway, the effects of latency on the data packets are minimized. 
5 Further supporting telephone communications, the operations of collecting and 

assembling digital samples into data packets may additionally comprise an echo 
cancellation operation, in which copies of the digital samples are stored locally in a 
buffer, and then used in comparison with received digital samples. As a result of the 
comparison, an echo cancellation signal can be generated to eliminate or reduce the echo 

10 caused by the transmitted digital samples being attenuated and returned to the sender by 
voice equipment at the far end. 

The echo cancellation process as described is an improvement over all prior art 
r in that since both ends are based from the common time reference CTR signal 002, and 
all other transit delays and jitter in the system are known apriori or are well-bounded, it 

1 5 is possible to very precisely align the stored samples with the retrieved samples in time. 
It is another object of the present invention to convey multiple telephone 
communications via scheduled data packets over a synchronous virtual pipe. A 
preferred embodiment of the present invention schedules the assembly of a plurality of 
digital sample streams into data packets in coordination with the common time reference 

20 so that a data packet is complete and prepared for transmission within a scheduled 
respective time frame for all associated time cycles. 

This scheduling is performed by taking a predefined and known amount of time 
that the assembly of a data packet will require and subtracting that from the scheduled 
lime frame. If the assembly of digital samples into a data packet starts at the scheduled 

25 stan time, it will complete just in time for transmission on the scheduled time frame over 
the synchronous virtual pipe. It is to be appreciated that this scheduling reduces the 
latency incurred by each data packet to the minimum possible; and that since data 
packets are conveyed by a synchronous virtual pipe, the jitter of the arrival times of the 
data packets at their destination is well-defined and bound to a small value. In fact, the 

30 jitter can be reduced to timing error associated with the clock signal from GPS, which 
can be maintained below one microsecond Both minimal latency and minimal jitter are 
requirements for conveying telephone communications and other real-time audio, visual, 
and audiovisual streams via data packets. 

The scheduled assembly takes the digital samples from a plurality of digital 

35 sample streams and collects and assembles them into a data packet The data packet 
thus can contain a fragment of a plurality of simultaneously occurring telephone 
communications or other types of real-time streams. The data packet may then be 
routed via a synchronous virtual pipe to its destination. The method of combining 
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multiple telephone communications together into a data packet provide^ for reducing the 
cost of the overhead associated with transmitting each telephone conversation, as the 
overhead of collection, assembly into data packets, and routing is then shared among all 
the telephone communications conveyed within the same data packet This combining is 

5 practical for telephone communications primarily because of the low data rate 

requirements associated with voice telephone communications. In one embodiment, the 
overhead associated with transmitting a data packet is fixed at 40 bytes. In this 
embodiment, collecting ten incoming voice streams could be assembled into data packets 
and routed together, thus reducing the effective overhead for any one stream of digital 

10 samples to 4 bytes, or alternatively, reducing the delay associated with collection and 
assembly of digital samples into data packets. 

FIG. 30 is a timing diagram illustrating multiplexing of multiple real-time 
• streams (e.g., telephone calls) into one data packet in the present invention. The 
controller 81 is responsive to receipt of multiple streams of digital samples and collects 

15 and assembles the samples over time into a data packet The collection and assembly of 
digital samples la, la', la" into a data packet is shown to start within time frame 1 of 
time cycle 0 in the example timing of FIG. 30. As shown, the collection and assembly 
of a data packet can complete within an interval less than or equal to the duration of one 
time cycle, and therefore repeats the process beginning and ending at the same relative 

20 time frames within the associated time cycles for each time cycle. In the illustrated 
example timing, the collection and assembly of digital samples into a data packet la 
completes 99 time frames later, in time frame 100 of time cycle 0. 

In an alternate embodiment, the operation of collection and assembly of digital 
samples into a data packet may additionally comprise the method of converting analog 

25 voice signals into digital samples for one or more of the streams of digital samples, prior 
to assembling the digital samples into a data packet In this alternate embodiment, the 
scheduling also factors in the additional time required to receive the convened digital 
samples from the analog to digital converter. 

The data packet representing the digital sample inputs la, la', la" is then 

30 transmitted lb via the SVP switch 10 to a synchronous virtual pipe during a predefined 
time frame. In the illustrated example, the data packet of digital samples assembled at la 
are transmitted lb starting at time frame 1 of time cycle 1. The transmission lb occurs 
simultaneously with the start of the operation of collection and assembly of digital 
samples into a new data packet of new samples 2a, 2a', 2a", and the process repeats in 

35 time for subsequent time cycles. 

FIG. 31 is a timing diagram illustrating demultiplexing of data packets into 
multiple streams (e.g., telephone calls) in the present invention. The controller 81 is 
responsive to receipt of data packets comprising a plurality of streams of digital samples 
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from a synchronous virtual pipe. The data packets arrive regularly Id aj a predefined 
time frame in each time cycle, which is time frame 3 in the illustrated example. The 
separation of digital samples from the data packet of streams of samples le, le', le" is 
scheduled, within the VoIP gateway of the present invention, to provide immediate 

5 separation of the data packet for each output stream thus providing a plurality of outputs 
of digital samples. Each output of digital samples is then relayed^to an external device, 
which in the preferred embodiment are digital to analog converters supporting, for 
example, a conventional analog telephone. In an alternate embodiment, the external 
device can be a digital phone, a digital video display, or any other form of digital audio, 

1 0 visual, or audiovisual device.. 

The regularity of arriving data packets at the same time frame of each time cycle 
provides for uninterrupted receipt of packets of digital samples, which in turn provides 
♦ for uninterrupted receipt of multiple streams of digital samples at each of the digital to 
analog converters. The jitter present in the received data packet arrival times is 

15 controlled by the common time reference to be very small and well-bounded. Because 
the separation of digital samples from the data packet can be scheduled to occur as soon 
as the data packet arrives at the VoIP gateway, the effects of latency on the data packets 
are minimized. 

As shown in FIGS. 30-31, this embodiment of the present invention permits 

20 multiple telephone communications to be conveyed via a single synchronous virtual 

pipe. One or more telephone communications are assembled together into data packets 
and the respective data packets are forwarded at predefined time frames through a 
synchronous virtual pipe to a destination, where the digital samples in the data packets 
are separated and directed to respectively one or more telephone communication 

25 destinations. The present invention permits telephone conversations to thus be trunked 
via synchronous virtual pipes to reduce the overhead associated with assembly of data 
packets and conveyance of data packets. This reduction in overhead is practical as a 
result of the relatively low data rate required for voice telephone communications. 
It is to be appreciated that multiple telephone communications can be 

30 independently converted, collected, and assembled into data packets in accordance with 
the description above for a single telephone communication, such that each of the 
multiple telephone communications results in a corresponding respective set of data 
packets. Each of the data packets is thus independently scheduled and transmitted over 
the synchronous virtual pipe. The scheduling may transmit multiple data packets within 

35 one or more time frame. Assembly of multiple streams of voice data independently into 
multiple data packets is an optional method of operation when the telephone 
communications are permitted to travel over the same synchronous virtual pipe to a 
similar destination. 
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FIG. 32 illustrates both a schematic block diagram of an end-to-end VoIP 
connection showing one implementation of a trunked phone communication as 
described above and with respect to FIGS. 30-31, and also shows a composite timing 
diagram showing end-to-end timing illustrating the timing of the schematic block 

5 diagram of an end-to-end VoIP connection. In the illustrated figure, multiple streams of 
digital samples are conveyed to the controller 81 of VoIP gateway, A 80 via digital 
sample inputs 82. The VoIP gateway 80 additionally comprises, as described above, an 
output port 40 coupled via communication link 41 to zero or more SVP switches 10, e.g. 
B, C. The zero or more SVP switches 10 comprise a virtual pipe 25, wherein each of the 

10 switches 10 is coupled to the next switch 10 in the virtual pipe 25 by a link 41. 

The virtual pipe begins at VoIP gateway A 80 and ends at VoIP gateway D 80 
which as described above incorporates an input port 30 and a controller 81. The 
controller 81 couples a plurality of outgoing streams of digital samples via links 83. 

The bottom of FIG. 32 illustrates a timing diagram of the operation of the logical 

15 connection as shown in the top of FIG. 32. Time progresses in the downward direction 
in this timing diagram. 

Conversion of analog voice to digital samples and the assembly of same digital 
samples into data packets occurs at times 1A/D, 2 AID, and 3A/D as shown in the 
figure. These conversion and assembly operations are scheduled to start once per time 

20 cycle at a predefined time frame. 

The data packets enter the synchronous virtual pipe at the output port 40 of the 
VoIP gateway A 80 in order and once per time cycle at a predefined time frame. The 
transmission of data packets via the synchronous virtual pipe is scheduled to occur once 
each time cycle at a predefined time frame. The actual transit times of data packets via 

25 the synchronous virtual pipe are shown as 1BCD, 2BCD, and 3BCD in FIG. 32. Due 
to the nature of the synchronous virtual pipe, the data packets arrive in order and once 
per time cycle at predefined time frames at the input port 30 of the destination VoIP 
gateway D 80 as shown in FIG. 32. 

The separation of digital samples from the data packets and conversion of digital 

30 samples to analog voice occurs during time intervals ID/A, 2D/A, and 3D/A as shown. 
The separated digital samples are then routed simultaneously to the appropriate digital 
output links 83. 

FIG. 26 illustrates the structure of a VoIP gateway of the present invention. The 
VoIP gateway 80 is comprised of a controller 81 coupled to an SVP switch 10. The 
35 controller 81 is also coupled via digital sample input links 82 and digital sample output 
links 83 to external voice devices (not shown). 

FIG. 26 illustrates the structure of a VoIP gateway of the present invention. The 
VoIP gateway 80 is comprised of a controller 81 coupled to an SVP switch 10. The 
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controller 81 is also coupled via digital sample input links 82 and digital sample output 
links 83 to external (e.g., voice) devices (not shown). 

FIG. 33 is a schematic block diagram of time frame call multiplexing using 
headerless time-based routing of the present invention. The left half of FIG. 33 
5 illustrates the structure of an alternate embodiment of the VoIP gateway. The VoIP 

gateway 80 is comprised of a controller 81 coupled to an S VP switch 10. The controller 
81 is also coupled via digital sample input links 82 and digital sample output links 83 to 
external voice devices (not shown). The SVP switch 10 of FIG. 33 is also coupled to 
one or more synchronous virtual pipes 41 by way of combination input/output ports 
10 30/40. 

The SVP switch 10 of FIG. 26 is further comprised of a GPS receiver 20 linked 
via a common time reference (CTR) signal 002 to each of the input/output ports 30/40. 
In this manner, a common time reference is supplied to each of the input ports and each 
of the output ports within the SVP switch 10. The CTR signal 002 is also coupled to 
1 5 the controller 81 as shown in the figure. 

The right half of FIG. 33 illustrates the timing of selected synchronous virtual 
pipes associated with the links 41. In the alternate embodiment of FIG. 33, the 
synchronous virtual pipes relay stripped data packets consisting solely of a payload 
portion. The header portion typically associated with data packets is not present with a 
20 stripped data packet. The links 41, which may each contain zero or more SVP switches 
10 as previously described, convey stripped data packets using a time-based routing 
method. 

FIGS. 33-34 depict a common time reference (CTR) 002 axis that is divided into 
time cycles. Each time cycle is divided into predefined time frames. Each of the time 

25 frame has predefined positions: a, b, c, and d of either fixed size (in time duration) or 
variable size (in time duration), consequently, the predefined position can have either 
fixed size data packets or variable size data packets, respectively. Each time frame can 
be further divided into time slots. Time frames utilize packet delimiters (PDs) 35C. 
The PDs can be one of the control codewords as shown in FIG. 5C PDs are used to 

30 indicate separations; packet delimiters can then be used to distinguish between multiple 
headerless data packets in the same time frames; and when using PDs in headerless 
time-based routing, the headerless data packets are permitted to have zero length. Time 
slots have a predetermined length or lengths and do not use packet delimiters. In an 
alternate embodiment, time slots may be delimited using a different delimiter than the 

35 one used as PDs. 

When using the time-based or position-based routing method of the alternate 
embodiment of the present invention, the position of the stripped data packet within a 
time cycle determines its destination. As shown symbolically in the right side of FIG. 
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33 and in FIG. 34, stripped data packets a, b, c and d in each time slot are respectively 
in the four consecutive time slots or positions within each time frame. Each first time 
slot or position in any time frame contains stripped data packets a, each second time slot 
or position in any time frame contains stripped data packets b, and so on as shown in 
5 the figure. The operation of the routing-controller 35 in the present embodiment is 

similar to that shown in FIG. 7, except that the values used to index into the lookup table 
35D is a time slot or position counter maintained by the controller 35B responsive to the 
packet delimiter signal 35C. In one variant embodiment, the value of the time slots 
within a time frame and the time frames within a time cycle may be alternatively defined 
10 by an in-band control codeword signal as discussed above. 

The present invention permits use as a call center, routing telephone 
communications from a plurality of origination points to a plurality of destination points 
■ and vice versa. This operation may include multi-party conference calls, using the 
multicasting routing provided by the switches in the synchronous virtual pipe of the 
1 5 present invention. Providing a conference call capability for large numbers of users is 
made easier by the use of a common time reference signal to coordinate the analog to 
digital conversion, the multiplexing, the assembly, the switching and routing, the 
separation, the demultiplexing, and the digital to analog conversion all to the same 
common timebase. 

20 From the foregoing, it will be observed that numerous variations and 

modifications may be effected without departing from the spirit and scope of the 
invention. It is to be understood that no limitation with respect to the specific apparatus 
illustrated herein is intended or should be inferred. It is, of course, intended to cover by 
the appended claims all such modifications as fall within the scope of the claims. 
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WHAT IS CLAIMED IS: 

1. A system for scheduling and managing data transfer of data packets, said system 
comprising: 

a plurality of switches with plurality of input ports and output ports, each with a 
5 unique address for receiving the data packets; 

a plurality of at least one virtual pipe each comprising at least two of the 
switches interconnected via communication links in a path, for transferring the data 
packets from at least one source to at least one destination; and 

a common time reference signal coupled to some of said switches; 
10 wherein the common time reference is partitioned into time frames, and wherein 

the transfer of the data packets is provided during respective ones of a plurality of 
predefined time frames; 

v wherein the time frames have at least one predefined duration; 

wherein each of the respective data packets is received by a first input port and 
1 5 transmitted by a second output port, and wherein the time frame used by the first input 
port has a first predefined duration and the time frame used by the second output port 
has a second predefined duration; and the system is further comprising: 

a scheduling controller for mapping from a first predefined time frame with the 
first predefined duration, within which the respective data packet is transferred into the 
20 respective switch, to a second predefined time frame with the second predefined 

duration, within which the respective data packet is transmitted out of the respective 
switch, wherein said scheduling controller is responsive to the common time reference 
signal. 

2. The system as in claim 1 , wherein the position of said data packet within said 
25 second predefined time frame is arbitrary. 

3. The system as in claim 1, wherein the time frame used by the input port has a 
first predefined duration and the time frame used by the output port has a second 
predefined duration. 

4. The system as in claim 3, wherein the time frames of the first predefined 
30 duration are longer than the time frames of the second predefined duration. 

5. The system as in claim 1, wherein a predefined number of contiguous time 
frames comprise a time cycle; and 

wherein the time cycles are contiguous. 

6. The system as in claim 1, wherein a first number of contiguous time frames of a 
35 first predefined duration comprise a time cycle of a third predefined duration; 

wherein the time cycles of the third predefined duration are contiguous; 
wherein a second number of contiguous time frames of the a second predefined 
duration comprise a time cycle of a fourth predefined duration; and 
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wherein the time cycles of the fourth predefined duration are contiguous. 

7 . The system as in claim 6, wherein the time cycle of the third predefined duration 
is equal to the time cycle of the fourth predefined duration. 

8. The system as in claim 6, wherein the time cycle of the third predefined duration 
5 is larger than the time cycle of the fourth predefined duration. 

9. The system as in claim 6, wherein the time cycle of the third predefined duration 
is smaller than the time cycle of the fourth predefined duration. 

10. The system as in claim 6, wherein a third number of time cycles of the third 
predefined duration comprise a first super cycle; 

1 0 wherein the first super cycles are contiguous; 

wherein a fourth number of time cycles of the fourth predefined duration 
comprise a second super cycle; and 
• wherein the second super cycles are contiguous. 

1 1 . The system as in claim 10, wherein the first super cycle and the second super 
1 5 cycle have equal durations. 

12. The system as in claim 10, wherein the first super cycle and the second super 
cycle start at a same time with respect to the common time reference. 

13. The system as in claim 10, wherein the first super cycle and the second super 
cycle have different durations. 

20 14. The system as in claim 5, wherein a fixed number of a plurality of contiguous 
ones of the time cycles comprise a super cycle; wherein the super cycle is periodic. 

15. The system as in claim 1, wherein the common time reference signal is coupled 
from a Global Positioning System (GPS). 

16. The system as in claim 1, wherein the common time reference signal is in 
25 accordance with the Coordinated Universal Time (UTC) standard. 

17. The system as in claim 15, wherein the super cycle duration is equal to one 
second as measured using the Coordinated Universal Time (UTC) standard. 

18. The system as in claim 1, wherein the transmission over each of said 
communication links is provided during a time frame with a duration selected from a 

30 plurality of predefined time frame durations. 

19. The system as in claim 1, wherein the mapping by the scheduling controller 
provides consistent fixed time frames between the input to and output from at least a 
selected one of the plurality of virtual pipes. 

20. The system as in claim 1, wherein the transmission over at least a selected one of 
35 the plurality of virtual pipes utilizes a plurality of time frame durations. 

2 1 . The system as in claim 1 , wherein a predefined number of contiguous time 
frames of the first predefined duration comprise a time cycle of a fifth predefined 
duration; 
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wherein the time cycles of the fifth predefined duration are contiguous; 

wherein a predefined number of contiguous time frames of the second 
predefined duration comprise a time cycle of a sixth predefined duration; 

wherein the time cycles of the sixth predefined duration are contiguous; 
5 wherein a predefined number ofcontiguous time frames of a third predefined 

duration comprise a time cycle of a seventh predefined duration; and 

wherein the time cycles of the seventh predefined duration are contiguous. 

22. The system as in claim 21, wherein the transmission over at least a selected one 
of the plurality of virtual pipes utilizes at least one of a time cycle of the fifth predefined 

10 duration, a time cycle of the sixth predefined duration, and a time cycle of the seventh 
predefined duration. 

23. The system as in claim 21 , wherein there are more than three different time frame 
■ durations; and 

wherein there are more than three different time cycle durations. 
15 24. The systems as in claim 1 , wherein each time frame at each of the input ports is 
grouped into time cycles, wherein each time frame duration at each of the input ports has 
one of a plurality of predefined durations; 

wherein the time frames at each of the output ports is grouped into time cycles, 
wherein each time frame duration at each of the output ports has one of a plurality of 
20 predefined durations; and 

a switching fabric for coupling incoming data packets between selected ones of 
the input ports and the output ports, wherein each of the selected input ports has an 
associated first time frame duration, and wherein each of the selected output ports has an 
associated second time frame duration. 
25 25. The systems as in claim 24, wherein one or more data packets can be 
communicated within each of the time frames. 

26. The systems as in claim 24, wherein a predefined number ofcontiguous il time 
frames of duration dl at a first input port are grouped into a time cycle icl, wherein il is 
at least 1; 

30 wherein a predefined number ofcontiguous i2 time frames of duration d2 at a 

second input port are grouped into a time cycle ic2, wherein i2 is at least 1 ; 

wherein a predefined number of contiguous i3 time frames of duration d3 at a 
third input port are grouped into a time cycle ic3, wherein i3 is at least 1; 

wherein a predefined number of contiguous ol time frames of duration tl at a 
35 first output port are grouped into a time cycle ocl, wherein ol is at least 1;. 

wherein a predefined number of contiguous o2 time frames of duration t2 at a 
second output port are grouped into a time cycle oc2, wherein o2 is at least 1; 

wherein a predefined number of contiguous o3 time frames of duration G at a 
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third output port are grouped into a time cycle oc3, wherein o3 is at leasul ; 

wherein the scheduling of data packets on the input ports and output ports of the 
switch have plurality of predefined mapping from: il-in-icl and i2-in-ic2 and i3-in-ic3 
to ol-in-ocl and o2-in-oc2 and o3-in-oc3. 
5 27. The system as in claim 26, further comprising: 

a routing controller with a routing table for selecting at least one output port that 
said respective data packets will be forwarded to; 

wherein the routing controller attaches a time of arrival (ToA) to incoming data 
packets at the input port using the predefined time frame duration and the time cycle 
10 associated with the respective input port; 

wherein the time of arrival (ToA) relates to the common time reference and is 
represented as a time frame number within a time cycle; and 

wherein the ToA has a unique representation on each of at least the first input 
port, the second input port, and the third input port. 
15 28. The system as in claim 27, wherein after the incoming data packet is transferred 
to one of the output ports, the ToA unique representation is utilized to transform to a 
unique output port representation on each of at least the first output port, the second 
output port, and the third output port 

29. The system as in claim 28, further comprising: 

20 a memory partitioned into plurality of buffers; and 

a scheduling controller for selecting one of the plurality of buffers; 
wherein the unique output port representation is used by the scheduling 
controller to select one of the plurality of buffers. 

30. The system as in claim 29, 

25 wherein each of the buffers is uniquely associated with one of the time frames; 

and 

wherein said one of the time frames is the time the data packet is forwarded from 
the output porL 

3 1 . The system as in claim 1 , further comprising: 

30 a controller system, for scheduling transfer of data packets between one of a 

point to point network and a shared medium, and an end station and the shared medium; 

a first scheduling controller for scheduling of a first time frame for the transfer 
of the data packets from the shared medium to the point to point network, responsive to 
the common time reference signals; and 
35 a second scheduling controller for scheduling a time interval for the transfer of 

the data packets from the end station to the shared medium, responsive to the first 
scheduling controller, 

wherein the time interval occurs immediately before the first time frame. 
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32. The system as in claim 3 1 , wherein the first and the second scheduling 
controllers schedule their respective data transfer in alternating sequential time order to 
effectuate the transfer of a plurality of the data packets over a plurality of the first time 
frames and a plurality of the time intervals. 
5 33. The system as in claim 31, further comprising an access time manager, wherein 
the first and the second scheduling controllers are part of the access time manager. 
34. The system as in claim 3 1 , wherein the time frames are structured into a time 
cycle comprised of a fixed number of contiguous time frames, which are structured into 
a stream of a plurality of contiguous time cycles. 
10 35. The system as in claim 34, wherein the scheduling of transmission of respective 
data packets occurs at a defined one of the time frame positions within each of the time 
cycles. 

36. The system as in claim 35, wherein the scheduling of transmission of respective 
data packets to the point-to-point network occurs at multiple defined ones of the time 

15 frame positions within each of the cycles. 

37. The system as in claim 31, wherein there are a plurality of end-stations; 
wherein the second scheduling controller schedules a plurality of time intervals 

for the transfer of plurality of data packets from the end-stations to the shared media 
network. 

20 38. The system as in claim 37, wherein the transfer of plurality of data packets from 
the end- stations to the shared media network is responsive to the first scheduling 
controller. 

39. The system as in claim 31, wherein the second scheduling controller is pan of 
the end-station. 

25 40. The system as in claim 39, the first scheduling controller further comprising 
TICK sending means for sending TICK signals, the second scheduling controller 
further comprising TICK receiving means for receiving TICK signals; 

wherein the transfer of data packets from the end station to the shared media 
network is regulated by the second scheduling controller responsive to the TICK 

30 signals. 

41. The system as in claim 3 1 , wherein the shared media network is at least one of 
an IEEE P1394 room network, an Ethernet local area network, a Data-Over-Cable 
Service Interface Specification (DOCSIS) cable modem network, an IEEE 802.14 cable 
modem network, an IEEE 802.1 1 wireless network, a Fiber Channel Arbitrated Loop 

35 (FC-AL) storage area network, and an Serial Storage Association (SSA) storage area 
network. 

42. Tne system as in claim 31, wherein the end-station is at least one of a video 
camera, a video cassette recorder (VCR), a video disk, a set-top box, a set-top box with 
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Ethernet connection to video camera and VCR, a desktop computer, a mobile unit, a disk 
drive, a tape drive, a semiconductor disk, an electronic disk, a telephone set, a video 
display, a video game input and output, and a computer work-station. 

43. The system as in claim 3 1 , wherein the second scheduling controller is part of at 
5 least one of the following: a cable-modem head-end, a wireless network base station, an 

EEEE 1394 shared media network, and a host adapter for storage area network. 

44. The system as in claim 1, further comprising: 
a source for transmitting periodic data bursts; 
a destination for receiving periodic data bursts; 

10 a first shared media network, coupled to the source for transmitting periodic data 

bursts and to the virtual pipe; and 

a second shared media network, coupled to the virtual pipe and to the destination 
For receiving periodic data bursts. 

45. The system as in claim 44, wherein the first shared media network is coupled to 
1 5 the input of the virtual pipe; and 

wherein the second shared media network is coupled to the output of the virtual 

pipe. 

46. The system as in claim 44, 

wherein there are a plurality of virtual pipes; 
20 wherein the first shared media network is coupled to the input of the a first 

virtual pipe and is coupled to the output of the a second virtual pipe; and 

wherein the second shared media network is coupled to the input of the a third 
virtual pipe and is coupled to the output of the a fourth virtual pipe. 

47. The system as in claim 44, wherein the periodic data bursts represent captured 
25 video frames by a video camera. 

48. The system as in claim 44, wherein the destination for receiving periodic data 
bursts provides for a display of video frames responsive to the respective periodic data 
bursts. 

49. The system as in claim 48, wherein there are a plurality of destinations for 

30 receiving the periodic data bursts, each providing for a respective display of video frames 
to a respective display. 

50. The system as in claim 48, wherein the display is at least one of a television (TV) 
set, a high definition TV (HDTV) set, a computer monitor, a flat panel display, a movie 
theater, a video display in a conference room, and a hand-held wireless video display. 

35 51. The system as in claim 44, further comprising a scheduling controller for 

defining one or more predefined time frames, and for scheduling the a synchronous 
transfer of the periodic data bursts commencing during respective scheduled ones of the 
time frames occurring closest in time to an occurrence of the respective periodic data 
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bursts from the source. 

52. The system as in claim 51, wherein the synchronous transfer is from the source 
to the destination. 

53. The system as in claim 51, wherein the source is coupled to at least one of a first 
5 IEEE 1394 shared media network, a first cable-modem system, and a second IEEE 1394 

shared media network that is coupled to a second cable-modem system; 

wherein the display is coupled to the destination via at least one of a third IEEE 
1394 shared media network, a third cable-modem system, and a fourth IEEE 1394 
shared media network that is coupled to a fourth cable-modem system. 
10 54. The system as in claim 44, wherein the periodic data bursts have complex 
periodicity. 

55. The system as in claim 54, wherein a predefined number of contiguous k time 
- frames are grouped into a time cycle, wherein k is at least 1; 

wherein a predefined number of contiguous 1 time cycles are grouped into a 
1 5 super cycle, and wherein 1 is at least 1 ; 

wherein the source of periodic data bursts are scheduled for transmission in 
re occurring predefined time frames in selected ones of said time cycles and super 
cycles. 

56. The system as in claim 55, wherein the periodic data bursts are scheduled for 
20 transmission in reoccurring predefined time frame positions within selected ones of the 

time cycles within each of the super cycles. 

57. The system as in claim 1, further comprising: 
a source of a stream of digital samples; 

a packeting subsystem for providing packetization of a plurality of the digital 
25 samples into a data packet; and 

a controller for defining a plurality of predefined time frames responsive to the 
common time reference signal, and for scheduling of transmission of associated 
respective ones of the data packets at respective selected ones of the predefined time 
frames; 

30 wherein the packeting subsystem provides packetization responsive to the 

controller, and wherein the packetization of each of the respective ones of the data 
packets is scheduled for completion prior to the respective selected predefined time 
frame. 

58. The system as in claim 57, wherein each respective one of the data packets is 
35 output from the gateway system during the respective selected predefined time frame. 

59. The system as in claim 57, wherein, for each respective one of the data packets, 
the packetization of the plurality of the digital samples into the data packets is completed 
immediately prior to the respective selected predefined time frames. 
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60. The system as in claim 57, wherein the time frames are scheduled and structured 
into a time cycle comprised of a fixed number of contiguous time frame positions which 
are structured into a stream of a plurality of contiguous time cycles. 

61. The system as in claim 60, wherein the scheduling of transmission of respective 
5 data packets occurs at a defined one of the time frame positions within each of the time 

cycles. 

62. The system as in claim 61, wherein the scheduling of transmission of respective 
data packets occurs at multiple defined ones of the time frame positions within each of 
the cycles. 

10 63. The system as in claim 57, wherein the stream of digital samples are at least one 
of digitized analog voice telephony, digitized uncompressed voice telephony, digitized 
compressed voice telephony, narrowband Integrated Service Digital Networks (ISDN), 
video, television (TV), high definition TV (HDTV), and high fidelity (Hi-Fi) audio. 

64. The system as in claim 57, wherein there are a plurality of streams of digital 
15 samples; and 

wherein the packeting subsystem provides for packetization of the data packets 
for each of the plurality of streams. 

65. The system as in claim 64, wherein the packeting subsystem provides for the 
packetization of the plurality of the digital samples from the plurality of the streams of 

20 digital samples into a single data packet; and 

wherein the packetization starts and ends synchronous to the common time 
reference signals. 

66. The system as in claim 65, wherein each of the respective data packets further 
comprises a payload with plurality of predefined positions; and 

25 wherein there is one respective predefined position in said payload for each of 

the streams for the digital samples from each of the streams in the respective data packet. 

67. The system as in claim 66, wherein each one of the predefined positions has an 
associated predefined maximum length. 

68. The system as in claim 66, wherein a position delimiter is provided between each 
30 of the predefined positions. 

69. The system as in claim 66, wherein each one of the predefined positions has an 
associated respective predefined position number, wherein the controller uniquely 
associates the position number with a respective one of the plurality of streams of digital 
samples. 

35 70. The system as in claim 66, wherein each of the predefined positions has an 

identifier uniquely associated with a respective one of the plurality of streams of digital 
samples. 

7 1 . The system as in claim 57, wherein a time reference of defined positions within 
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defined time frames is determined responsive to the common time reference signals; 

wherein the packeting subsystem provides means wherein each of tfie data 
packets is assigned an associated one of the defined positions within a one of the 
defined time frames, responsive to the common time reference signals. 
5 72. The system as in claim 57, wherein each of the time frames is comprised of a 
plurality of predefined positions; 

wherein there are a plurality of streams of digital samples; 

wherein the packeting subsystem provides for the packetization of a plurality of 
the digital samples from each one of a respective plurality of the streams of digital 
10 samples; and 

wherein the respective digital samples from each one of the respective streams 
has one respective predefined position in said time frame. 

73. The system as in claim I, further comprising: 

a first voice over Internet Protocol (IP) gateway and wherein a final switch within 
15 the virtual pipe is connected to provide an output coupled to transmit to a second voice 
over IP gateway, 

wherein the common time reference signal is coupled to the first and the second 
voice over IP gateway; 

a controller for determining a plurality of predefined time frames responsive to 
20 the common time reference signal, and for determining a schedule of selected ones of 
the predefined time frames for packetization of respective packetized data during the 
selected ones of the predefined time frames; and 

wherein the second voice over IP gateway is comprised of a depacketizing 
subsystem for depacketizing the packetized data to provide an output of a plurality of 
25 digital samples, responsive to the controller. 

74. The system as in claim 73, wherein the depacketization subsystem completes the 
depacketization prior to the respective predefined time frame associated with the 
packetization of the respective packetized data, responsive to the controller. 

75. The system as in claim 73, wherein the packetized data is comprised of data from 
30 a plurality of separate original streams of digital samples; 

wherein the depacketizing system provides for the depacketization of the 
packetized data into a plurality of separate streams of digital samples corresponding to 
the respective separate original streams of the digital samples. 

76. The system as in claim 73, wherein the packetized data is comprised of a 
35 plurality of sub-units, each associated with a separate one of the streams of digital 

samples, with each sub-unit delimited from other adjacent sub-units by a position 
ielimiter, 

wherein the depacketizing subsystem is responsive to the position delimiters for 
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separating the respective packetized data into the respective associated plurality of 
separate streams of the digital samples. 

77. The system as in claim 75, wherein the packetized data has a predefined structure 
that is comprised of a plurality of predefined sub-units of predefined size; 
5 wherein the depacketizing subsystem provides the depacketizadon into the 

plurality of separate streams of digital data responsive to the predefined structure. 
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